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HEATH, THOMAS S. // 1 


Examiner 

Paulos M. Natnael 


Art Unit 

2614 





- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)13 Responsive to communication(s) filed on 12 December 2002 . 
2a)n This action is FINAL. 2b)l3 This action is non-final, 

3) n Since this application is in condition for allowance except for formal nnatters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) 13 Claim(s) 1-22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) \3 Claim(s) is/are allowed. 

6) 13 Claim(s) 1-22 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) 0 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are: a)n accepted or b)^ objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

11) 0 The proposed drawing correction filed on is: a)n approved b)n disapproved by the Examiner. 

If approved, con-ected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§119 and 120 

13) 0 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-{d) or (f). 

a)nAII b)n Some*c)n None of: 

!□ Certified copies of the priority documents have been received. 

2.n Certified copies of the priority documents have been received in Application No. . 



3.n Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) 0 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 . 

Attach ment(s) 



1) 13 Notice of References Cited (PTO-892) 

2) CH Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) CH Infornnation Disclosure Statement{s) (PTO-1449) Paper No(s) . 



4) n Interview Summary (PTO-41 3) Paper No(s). 

5) n Notice of Informal Patent Application (PTO-1 52) 

6) n Other: 



U.S. Patent and Trademark Office 

PTO-326 (Rev. 04-01) 



Office Action Summary 



Part of Paper No. 7 
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DETAILED ACTION 



Claim Rejections - 35 USC § 102 



1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 

form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in (1 ) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

2. Claims 1,2,4,5,7,11,12,20-22 are rejected under 35 U.S.C. 102(e) as being 
anticipated by De Bonet et a!., U.S. Pat. No. 6,510,177. 



Considering claim 1, De Bonet et al. disclose all claimed subject matter: 

a) the claimed method of extracting a sequence of video frames is met by step of 

Extract l-Frames and motion Vectors From base Layer 910, FIG. 9; 



b) the claimed method of sampling each of the video frames is met by step 91 5, 
upsample Extracted l-Frames, Fig. 9; 



c) the claimed method of interpolating the up sampled video frames is met by step 920, 
Generate predicted l-frames, FIG.1; 
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d) the claimed method of aligning the interpolated video frames is inherent, because the 
alignment is a necessary step or process, without which the image wouldn't be 
displayed properly. 

e) the claimed method of creating a single image from the aligned video frames is met 
by step 960, Output Enhancement Layer 960, Fig.9; 

Considering claim 2, the claimed method wherein the sequence of video frames are low 
resolution images is met by the disclosure that the "base layer contains low-resolution 
video information" (see Abstract). 

Considering claim 4, the claimed method wherein said align step comprises aligning the 
video images in an x direction and a y direction in a center portion of interest in each 
video frame is inherent, because alignment of images implies in all directions. 

Considering claim 5, the claimed comprising extracting the sequence of video frames at 
30 frames/sec is inherent, because the rate of 30 frames/sec is standard in 
video/television systems, for example. 

Considering claim 7, the claimed method of correlating the up sampled video images; 
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Regarding claim 7, see rejection of claim 1(c). 

Considering claim 11, identifying commonality from one individual frame to the next and 
overlapping the individual frames and displaying an image representing a continuous 
area is inherent because individual frames must be overlapped to be displayed as a 
continuous image. 

Considering claim 12, extracting the sequence of video frames at 30 frames/sec is 
inherent, because the rate of 30 frames/sec is standard in television systems. 

Considering claim 20, see rejection of claim 1 . 

Considering claim 21, De Bonet et al. disclose the following claimed subject matter, 
note; 

a) the claimed at least one sequence of machine executable instructions is met by the 
Application Programs 134, FIG. 1. (see col. 5, line 49 to col. 7, line 20) 

b) the claimed a medium bearing the executable instructions in machine form, wherein 
execution of the instructions by one or more processor causes the one or more 
processor to extract a sequence of video frames, up sample each of the video frames; 
interpolate the up sampled video frames; align the interpolated video frames; and create 
a single image from the aligned video frames; 
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Regarding b), see rejection of claim 1 

Considering claim 22, De Bonet et al. disclose the following claimed subject matter, 
note; 

a) the claimed processor is met by Processing Unit 21, FIG. 1 ; 

b) the claimed memory coupled to said processor is met by system memory 104, FIG. 
1; 

c) the claimed memory having stored therein sequences of instructions when executed 
by said processor, causes said processor to perform the steps is met by the 
Applications Programs, 134 FIG. 1. 

d) the claimed steps of extract a sequence of video frames; up sample each of the video 
frames; interpolate the up sampled video frames; align the interpolated video frames; 
and create a single image from the aligned video frames; 

Regarding d), see rejection of claim 1 . 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 3,6,10, 13,14, are rejected under 35 U.S.C. 103(a) as being unpatentable 
over De Bonet et al. U.S. Pat. No. 6,510,177. 
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Considering claim 3, the claimed method wherein said up sample step is by a factor of 
4; 

Regarding claim 3, De Bonet et al do not disclose whether the up sampling is by 
a factor of 4. However, it would have been obvious matter of design choice to modify 
the De Bonet reference by having an up sampling of factor of 4, or any other factor, 
since applicant has not disclosed that having the sampling factor of 4 solves any stated 
problem or is for any particular purpose, and it appears that any up sampling factor 
would perform equally well with the disclosed sampling method of De Bonet. 

Considering claim 6, the claimed wherein the sequence of video frames includes 5 
video frames; 

Regarding claim 6, De Bonet et al do not disclose the actual number of frames in 
the sequence. However, it would have been an obvious matter of design choice to 
modify the De Bonet reference by choosing any number of sequence of video frames, 
since applicant has not disclosed that having five video frames in a sequence of video 
frames solves any stated problem and it appears that any number of frames would 
perform equally well with the disclosed up sampling method of the reference of De 
Bonet. 

Considering claim 10, the claimed aligning each the extracted sequence of video frames 
before said up sample step; 
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Regarding claim 10, see rejection of claim 1(c ). 

Considering claim 13, the claimed wherein the sequence of video frames includes 5 
video frames. 

Regarding claim 13, see rejection of claim 6. 

Considering claim 14, the claimed correlating the up sampled video images is inherent, 
because it's a necessary step or process during sampling and/or interpolating of the 
video images. 



3. Claims 8,9,15-19 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over De Bonet et al. U.S. Pat. No. 6,510,177 in view of Szeliski et a!., U.S. Pat. No. 
6,018,349. 

Considering claim 8, the claimed averaging a pixel intensity from each of the up 
sampled video frames; 

Regarding claim 8, De Bonet et al. do not specifically disclose averaging the pixel 
intensity. However, averaging pixel intensity for data picked up by cameras would be 
obvious to perform in video processing so that the image quality is enhanced further. 
In that regard, Szeliski et al. discloses a patch-based alignment method and apparatus 
for construction of image mosaics, wherein Szeliski specifically teaches that "The 
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blending of the corresponding pixel values employs a weighted average... Each weight 
Wk is proportional to the proximity of the image pixel location Xk to the center of the 
particular image Ik..." (col. 29, line 58 through col. 30, lines 6) Therefore, it would have 
been obvious to the skilled in the art at the time the invention was made to provide pixel 
averaging and modify the system of De Bonet in order to further enhance the quality of 
the video data. 

Considering claim 9, compensating for platform movement and rotation zoom. 

Regarding claim 9, De Bonet et al. do not specifically disclose compensating for 
platform movement and rotation zoom. However, such compensating would have to be 
made in order to prevent images from being distorted and other artifacts introduced in 
the composite image. 

Szeliski discloses a patch-based alignment method and apparatus for 
construction of image mosaics. Szeliski teaches that "Based on this rotational 
panoramic representation, block adjustment (global alignment) and deghosting (local 
alignment) methods disclosed herein significantly improve the quality of image mosaics, 
thereby enabling the construction of mosaics from images taken by hand-held 
cameras." (Col. 32, lines 13-9) Therefore, it would have been obvious to the skilled in 
the art at the time the invention was made to provide for platform movement and 
rotation zoom compensation and modify the system of De Bonet in order to prevent 
images from being distorted and artifacts introduced in the composite image and 
enhance the quality of the video image. 
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Considering claim 15, see rejection of claim 8; 
Considering claim 16, see rejection of claim 9; 

Considering claim 17, the claimed aligning each the extracted sequence of video frames 
before said up sample step is inherent, because alignment is a necessary step or 
process, without which the image wouldn't be displayed properly. 

Considering claim 18, see rejection of claim 1 1 . 
Considering claim 19, see rejection of claim 12. 



Response to Arguments 

4. Applicant's arguments with respect to claim 1-22 have been considered but are 
moot in view of the new ground(s) of rejection. 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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Astle, U.S. Pat. No. 5,485,61 1 discloses a video database indexing and nnethod 
of presenting video database index to a user. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Paulos M. Natnael whose telephone number is (703) 
305-0019. The examiner can normally be reached on 6:30am -3pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, John Miller can be reached on (703) 305-4795. The fax phone numbers for 
the organization where this application or proceeding is assigned are (703) 872-9314 for 
regular communications and (703) 872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is (703) 305- 
3900. 

Paulos Natnael 
February 24, 2003 
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